Poisson-type random measure

From HandWiki
Short description: Family of three random counting measures


Poisson-type random measures are a family of three random counting measures which are closed under restriction to a subspace, i.e. closed under thinning. They are the only distributions in the canonical non-negative power series family of distributions to possess this property and include the Poisson distribution, negative binomial distribution, and binomial distribution.[1] The PT family of distributions is also known as the Katz family of distributions,[2] the Panjer or (a,b,0) class of distributions[3] and may be retrieved through the Conway–Maxwell–Poisson distribution.[4]

Throwing stones

Let [math]\displaystyle{ K }[/math] be a non-negative integer-valued random variable [math]\displaystyle{ K\in\mathbb{N}_{\ge0}=\mathbb{N}_{\gt 0}\cup\{0\} }[/math]) with law [math]\displaystyle{ \kappa }[/math], mean [math]\displaystyle{ c\in(0,\infty) }[/math] and when it exists variance [math]\displaystyle{ \delta^2\gt 0 }[/math]. Let [math]\displaystyle{ \nu }[/math] be a probability measure on the measurable space [math]\displaystyle{ (E,\mathcal{E}) }[/math]. Let [math]\displaystyle{ \mathbf{X}=\{X_i\} }[/math] be a collection of iid random variables (stones) taking values in [math]\displaystyle{ (E,\mathcal{E}) }[/math] with law [math]\displaystyle{ \nu }[/math].

The random counting measure [math]\displaystyle{ N }[/math] on [math]\displaystyle{ (E,\mathcal{E}) }[/math] depends on the pair of deterministic probability measures [math]\displaystyle{ (\kappa,\nu) }[/math] through the stone throwing construction (STC) [5]

[math]\displaystyle{ \quad N_\omega(A) = N(\omega,A) = \sum_{i=1}^{K(\omega)}\mathbb{I}_A(X_i(\omega))\quad \text{for} \quad\omega\in\Omega,\,\,\,A\in\mathcal{E} }[/math]

where [math]\displaystyle{ K }[/math] has law [math]\displaystyle{ \kappa }[/math] and iid [math]\displaystyle{ X_1,X_2,\dotsb }[/math] have law [math]\displaystyle{ \nu }[/math]. [math]\displaystyle{ N }[/math] is a mixed binomial process[6]

Let [math]\displaystyle{ \mathcal{E}_+=\{f: E\mapsto\mathbb{R}_+\} }[/math] be the collection of positive [math]\displaystyle{ \mathcal{E} }[/math]-measurable functions. The probability law of [math]\displaystyle{ N }[/math] is encoded in the Laplace functional

[math]\displaystyle{ \quad\mathbb{E} e^{-N f} =\mathbb{E} (\mathbb{E} e^{-f(X)})^K =\mathbb{E} (\nu e^{-f})^K=\psi(\nu e^{-f})\quad\text{for}\quad f\in\mathcal{E}_+ }[/math]

where [math]\displaystyle{ \psi(\cdot) }[/math] is the generating function of [math]\displaystyle{ K }[/math]. The mean and variance are given by

[math]\displaystyle{ \quad\mathbb{E} Nf =c\nu f }[/math]

and

[math]\displaystyle{ \quad\mathbb{V}\text{ar} Nf = c\nu f^2 + (\delta^2-c) (\nu f)^2 }[/math]

The covariance for arbitrary [math]\displaystyle{ f,g\in\mathcal{E}_+ }[/math] is given by

[math]\displaystyle{ \quad\mathbb{C}\text{ov}(Nf,Ng) = c\nu(fg) + (\delta^2-c)\nu f \nu g }[/math]

When [math]\displaystyle{ K }[/math] is Poisson, negative binomial, or binomial, it is said to be Poisson-type (PT). The joint distribution of the collection [math]\displaystyle{ N(A),\ldots,N(B) }[/math] is for [math]\displaystyle{ i,\ldots, j \in \N }[/math] and [math]\displaystyle{ i+\cdots+j =k }[/math]

[math]\displaystyle{ \mathbb{P}(N(A)=i,\ldots, N(B)=j)=\mathbb{P}(N(A)=i,\ldots, N(B)=j|K=k)\,\mathbb{P}(K=k)=\frac{k!}{i!\cdots j!}\,\nu(A)^i\cdots \nu(B)^j\, \mathbb{P}(K=k) }[/math]

The following result extends construction of a random measure [math]\displaystyle{ N=(\kappa,\nu) }[/math] to the case when the collection [math]\displaystyle{ \mathbf{X} }[/math] is expanded to [math]\displaystyle{ (\mathbf{X},\mathbf{Y})=\{(X_i,Y_i)\} }[/math] where [math]\displaystyle{ Y_i }[/math] is a random transformation of [math]\displaystyle{ X_i }[/math]. Heuristically, [math]\displaystyle{ Y_i }[/math] represents some properties (marks) of [math]\displaystyle{ X_i }[/math]. We assume that the conditional law of [math]\displaystyle{ Y }[/math] follows some transition kernel according to [math]\displaystyle{ \mathbb{P}(Y\in B|X=x)=Q(x,B) }[/math].

Theorem: Marked STC

Consider random measure [math]\displaystyle{ N=(\kappa,\nu) }[/math] and the transition probability kernel [math]\displaystyle{ Q }[/math] from [math]\displaystyle{ (E, \cal E) }[/math] into [math]\displaystyle{ (F, \cal F) }[/math]. Assume that given the collection [math]\displaystyle{ \mathbf{X} }[/math] the variables [math]\displaystyle{ \mathbf{Y}=\{Y_i\} }[/math] are conditionally independent with [math]\displaystyle{ Y_i\sim Q(X_i,\cdot) }[/math]. Then [math]\displaystyle{ M=(\kappa, \nu\times Q) }[/math] is a random measure on [math]\displaystyle{ (E\times F, \cal E\otimes F) }[/math]. Here [math]\displaystyle{ \mu=\nu\times Q }[/math] is understood as [math]\displaystyle{ \mu(dx,dy)=\nu(dx)Q(x,dy) }[/math]. Moreover, for any [math]\displaystyle{ f\in ({\cal E}\otimes {\cal F})_+ }[/math] we have that [math]\displaystyle{ \mathbb{E} e^{-M f}=\psi(\nu e^{-g}) }[/math] where [math]\displaystyle{ \psi(\cdot ) }[/math] is pgf of [math]\displaystyle{ K }[/math] and [math]\displaystyle{ g\in \mathcal{E}_+ }[/math] is defined as [math]\displaystyle{ e^{-g(x)}= \int_F Q(x,dy)e^{-f(x,y)}. }[/math]

The following corollary is an immediate consequence.

Corollary: Restricted STC

The quantity [math]\displaystyle{ N_A=(N\mathbb{I}_A,\nu_A) }[/math] is a well-defined random measure on the measurable subspace [math]\displaystyle{ (E\cap A, \mathcal{E}_A) }[/math] where [math]\displaystyle{ \mathcal{E}_A=\{A\cap B: B\in\mathcal{E}\} }[/math] and [math]\displaystyle{ \nu_A(B)=\nu(A\cap B)/\nu(A) }[/math]. Moreover, for any [math]\displaystyle{ f\in\mathcal{E}_+ }[/math], we have that [math]\displaystyle{ \mathbb{E} e^{-N_A f} = \psi(\nu e^{-f}\mathbb{I}_A+b) }[/math] where [math]\displaystyle{ b=1-\nu(A) }[/math].

Note [math]\displaystyle{ \psi(\nu e^{-f}\mathbb{I}_A+1-a)=\psi_A(\nu_A e^{-f}) }[/math] where we use [math]\displaystyle{ \nu e^{-f}\mathbb{I}_A=a\nu_A e^{-f} }[/math].

Collecting Bones

The probability law of the random measure is determined by its Laplace functional and hence generating function.

Definition: Bone

Let [math]\displaystyle{ K_A = N\mathbb{I}_A }[/math] be the counting variable of [math]\displaystyle{ K }[/math] restricted to [math]\displaystyle{ A\subset E }[/math]. When [math]\displaystyle{ \{N\mathbb{I}_A: A\subset E\} }[/math] and [math]\displaystyle{ K=N\mathbb{I}_E }[/math] share the same family of laws subject to a rescaling [math]\displaystyle{ h_a(\theta) }[/math] of the parameter [math]\displaystyle{ \theta }[/math], then [math]\displaystyle{ K }[/math] is a called a bone distribution. The bone condition for the pgf is given by [math]\displaystyle{ \psi_{\theta}(at+1-a)=\psi_{h_a(\theta)}(t) }[/math].

Equipped with the notion of a bone distribution and condition, the main result for the existence and uniqueness of Poisson-type (PT) random counting measures is given as follows.

Theorem: existence and uniqueness of PT random measures

Assume that [math]\displaystyle{ K\sim \kappa_\theta }[/math] with pgf [math]\displaystyle{ \psi_\theta }[/math] belongs to the canonical non-negative power series (NNPS) family of distributions and [math]\displaystyle{ \{0,1\}\subset\text{supp}(K) }[/math]. Consider the random measure [math]\displaystyle{ N=(\kappa_\theta,\nu) }[/math] on the space [math]\displaystyle{ (E,\mathcal{E}) }[/math] and assume that [math]\displaystyle{ \nu }[/math] is diffuse. Then for any [math]\displaystyle{ A\subset E }[/math] with [math]\displaystyle{ \nu(A)=a\gt 0 }[/math] there exists a mapping [math]\displaystyle{ h_a:\Theta\rightarrow\Theta }[/math] such that the restricted random measure is [math]\displaystyle{ N_A=(\kappa_{h_a(\theta)},\nu_A) }[/math], that is,

[math]\displaystyle{ \quad \mathbb{E} e^{-N_A f} = \psi_{h_a(\theta)}(\nu_A e^{-f})\quad \text{for}\quad f\in\mathcal{E}_+ }[/math]

iff [math]\displaystyle{ K }[/math] is Poisson, negative binomial, or binomial (Poisson-type).

The proof for this theorem is based on a generalized additive Cauchy equation and its solutions. The theorem states that out of all NNPS distributions, only PT have the property that their restrictions [math]\displaystyle{ N\mathbb{I}_A }[/math] share the same family of distribution as [math]\displaystyle{ K }[/math], that is, they are closed under thinning. The PT random measures are the Poisson random measure, negative binomial random measure, and binomial random measure. Poisson is additive with independence on disjoint sets, whereas negative binomial has positive covariance and binomial has negative covariance. The binomial process is a limiting case of binomial random measure where [math]\displaystyle{ p\rightarrow 1, n\rightarrow c }[/math].

Distributional self-similarity applications

The "bone" condition on the pgf [math]\displaystyle{ \psi_\theta }[/math] of [math]\displaystyle{ K }[/math] encodes a distributional self-similarity property whereby all counts in restrictions (thinnings) to subspaces (encoded by pgf [math]\displaystyle{ \psi_A }[/math]) are in the same family as [math]\displaystyle{ \psi_\theta }[/math] of [math]\displaystyle{ K }[/math] through rescaling of the canonical parameter. These ideas appear closely connected to those of self-decomposability and stability of discrete random variables.[7] Binomial thinning is a foundational model to count time-series.[8][9] The Poisson random measure has the well-known splitting property, is prototypical to the class of additive (completely random) random measures, and is related to the structure of Levy processes, the jumps of Kolmogorov equations (Markov jump process), and the excursions of Brownian motion.[10] Hence the self-similarity property of the PT family is fundamental to multiple areas. The PT family members are "primitives" or prototypical random measures by which many random measures and processes can be constructed.

References

  1. Caleb Bastian, Gregory Rempala. Throwing stones and collecting bones: Looking for Poisson-like random measures, Mathematical Methods in the Applied Sciences, 2020. doi:10.1002/mma.6224
  2. Katz L.. Classical and Contagious Discrete Distributions ch. Unified treatment of a broad class of discrete probability distributions, :175-182. Pergamon Press, Oxford 1965.
  3. Panjer Harry H.. Recursive Evaluation of a Family of Compound Distributions. 1981;12(1):22-26
  4. Conway R. W., Maxwell W. L.. A Queuing Model with State Dependent Service Rates. Journal of Industrial Engineering. 1962;12.
  5. Cinlar Erhan. Probability and Stochastics. Springer-Verlag New York; 2011
  6. Kallenberg Olav. Random Measures, Theory and Applications. Springer; 2017
  7. Steutel FW, Van Harn K. Discrete analogues of self-decomposability and stability. The Annals of Probability. 1979;:893–899.
  8. Al-Osh M. A., Alzaid A. A.. First-order integer-valued autogressive (INAR(1)) process. Journal of Time Series Analysis. 1987;8(3):261–275.
  9. Scotto Manuel G., Weiß Christian H., Gouveia Sónia. Thinning models in the analysis of integer-valued time series: a review. Statistical Modelling. 2015;15(6):590–618.
  10. Cinlar Erhan. Probability and Stochastics. Springer-Verlag New York; 2011.